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An  Algebraic  Approach  to 
A  Calculus  of  Functional  Differences: 
Fixed  Differences  and  Integrals 


* 

B.  J.  MacLennan 
Computer  Science  Department 
Naval  Postgraduate  School 
Monterey,  CA  93943 

Abstract 

We  introduce  a  notion  of  functional  differences  in  which  the  difference  of  a  function  /  with  respect 
to  a  function  h  is  that  function  g  that  describes  how  the  value  of  /  changes  when  its  argument  is 
altered  by  h:  f  h(x)  ~  g\f(x)\.  We  also  introduce  the  inverse  operation  of  functional  integra¬ 
tion  and  derive  useful  properties  of  both  operations.  The  result  is  a  calculus  that  facilitates 
derivation  and  reasoning  about  recursive  programs.  This  is  illustrated  in  a  number  of  simple 
examples.  The  present  report  uses  algebraic  methods  to  establish  preliminary  results  pertaining 
to  fixed  differences,  that  is,  functional  differences  that  do  not  depend  on  the  value  of  the  argu¬ 
ment  x. 


1.  Motivation 


Simple  recursive  definitions  often  take  the  following  form: 

A o  ■'  !/o 

f(hx)  g(fx),  for  x^x0  (1) 


The  assumption  here  is  that  an  arbitrary  domain  value  x  can  be  reached  by  finitely  many  appli¬ 
cations  of  h.  That  is,  for  all  acceptable  x  there  is  an  n  such  that  x  -  hn  x0.  More  general  pat¬ 
terns  of  recursive  definition  will  be  considered  in  Section  6  and  more  generally  in  ^lacLennan 
'88  . 

Many  of  the  results  in  this  report  are  included  in  [MacLennan  '86  .  however,  that  report  used 
methods  from  the  calculus  of  relations  [Carnap  '58  .  The  present  report  obtains  the  same  results 
more  easily  by  use  of  the  methods  of  abstract  algebra.  The  reason  that  the  algebraic  approach  is 
easier  seems  to  be  that  the  algebraic  notion  of  a  function,  which  incorporates  the  domain  and 
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codomain  as  part  of  its  definition,  automatically  takes  rare  of  issues  that  must  otherwise  be  han¬ 
dled  explicitly.  In  particular,  the  algebraic  notation  (and  its  assumption  that  all  functions  are 
total)  simplifies  reasoning  about  the  domains  of  functions.  Comparing  the  derivations  in 
MacLennan  '86'  and  the  present  report  is  illuminating  in  this  regard.  The  algebraic  approach  is 
essential  for  the  investigation  of  variable  differences  and  their  associated  integrals  that  will  be 
presented  in  a  later  report  [MacLennan  88:;  for  now  we  restrict  our  attention  to  fixed 
differences.1 

In  deriving  a  recursive  definition  for  a  particular  /,  there  are  four  unknowns  that  must  be 
found,  g ,  A,  x0  and  y0.  Since  A  and  z0  are  usually  determined  bv  the  domain  in  question  (e.g., 
they  are  zero  and  the  successor  function  for  the  domain  of  natural  numbers),  and  y0  is  usually 
easily  determined  from  the  definition  of  /,  the  main  problem  is  determining  the  function  g. 

To  see  how  this  can  be  done  consider  the  second  line  in  Eq.  1: 

f{h*)  -  g(fx) 

The  function  g  tells  us  how  much  the  value  of  the  function  /  changes  whut  its  argument  is 
changed  by  A.  That  is,  if  f's  argument  is  changed  by  A.  then  its  value  is  changed  by  g.  This 
equation  is  analogous  to  the  finite  difference  equation 

/  (A  ♦  /)  g  f  (/  /) 

The  difference  is  that  in  the  first  equation  the  “amounts  of  change"  are  expressed  as  functions 
rather  than  numbers,  as  they  are  in  the  finite  difference  equation.  This  is  because  we  want  to  be 
able  to  deal  with  functions  whose  domains  and  ranges  are  nonnumeric  (e.g..  lists,  sets,  relations).* 
Based  on  this  analogy  we  introduce 

Definition  1:  Suppose  /:  S  •  7'.  y.  T  •  T  and  A:  >’  •  S’.  VVe  define  g  to  be  a  (Jiied)  func- 

I  Note  that  for  futd  differences  there  is  no  distinction  between  forward  differences  and  backward  differences.  This 
distinction  will  become  important  in  the  study  of  variable  differences 
.!  \  different  notion  of  fumtional  differences  is  dos<  nbed  in  I  *  a  i  r  c*  K  Koenig  Theirs  is  addressed  to  the 

problem  of  updating  data  structures  such  as  sets  in  an  imperative  context 


-2- 


tional  difference  of  /  with  respect  to  k  if  and  only  if  it  satisfies  /  »  h  g  •  /.  Furthermore,  if 
the  functional  difference  is  unique,  we  write  g  -  h  A  /,  and  call  g  the  "h  difference  of  /."  We 
also  call  g  "the  change  in  /  with  respect  to  h"  or  "the  change  in  /  given  the  change  h."  Thus, 
when  the  difference  exists  and  is  unique  we  have 


/  '  h  (h  A  f)  '  f 


(2) 


2.  Existence  and  Uniqueness  of  Fixed  Differences 

Equation  2  defines  the  functional  difference  implicitly:  to  get  an  explicit  definition  we  need  to 
solve  it  for  h  A  /.  This  can  be  accomplished  by  composing  with  the  inverse  of  /,  /"  * ,  on  both 
sides  of  the  equation  to  yield: 

h  A  /  =  /  *  h  •  /-> 


This  seems  to  yield  an  explicit  formula  for  the  functional  difference,  but  it  is  necessary  to  be  more 
careful,  since  it  assumes  the  existence  of  the  (right)  inverse  /  *.  Recall  that  a  right  inverse  fT  \ 
with  /  °  /r  1  Ir,  exists  only  if  /  is  surjective.  (We  write  I T  for  the  identity  I:  T  -  T.) 

Theorem  1:  Let  /:  S  —  T  be  a  surjection,  let  h:  S  •  S.  and  let  g:  T  •  T  be  any  function 
satisfying  the  equation  f  h.  g  •  f.  Then  g  /  ’  h  =  ft where  fr  1  is  a  right  inverse  of  /. 

Proof:  We  compose  on  the  right  with  f,  1  on  both  sides  of  the  equation  and  simplify: 

9  f  f  -  h 

9  f  /,  ‘  !  h  !r' 

9  If  /  A  '  ' 

9  /  A  /,  ' 


The  preceding  theorem  assumes  a  difference  cmm-,.  The  following  theorem  eM-iMishe*-  conditions 


ufficient  for  its  existence. 


Theorem  2:  Let  /:  5  —  T  be  an  injection  and  let  h:  S  -*  S.  The  functional  equation 
f  °  h  =  g  °  f  has  solutions  /  ■  h  »  ft l,  for  each  left  inverse  /,  1  of  /. 

Proof:  For  convenience  we  represent  composition  by  juxtaposition  when  no  ambiguity  will 
result.  Since  /  is  injective  it  has  a  left  inverse  /,  ,  with  ff  '/  --■=  Is.  Hence,  letting  g  -  fkf  we 
have 

9f  =  (/A/r1)/  =  /M/r7)  =  AIS  =  /fc 

Hence,  the  difference  equation  is  satisfied,  c 


We  observe  in  passing  that  none  of  the  preceding  results  depend  on  h  being  either  injective  or 
surjective.  Thus,  they  apply  to  any  function  h:  S  -»  S.z 

Theorem  2  establishes  sufficient  conditions  for  the  existence  of  solutions  to  the  difference 
equation,  namely  that  /  is  an  injection.  The  following  theorems  establish  necessary  and  sufficient 
conditions  for  the  existence  and  uniqueness  of  solutions.  However,  to  state  them  we  need  the  con¬ 
cept  of  an  equivalence  kernel  JMacLane  &  Birkhoff '67  . 

Definition  2:  The  equivalence  kernel  Ef  of  a  function  /:  S  -  T  is  the  following  relation  on 

5  x  S: 


Ef  =  {  (r.  z' )  C  S  x  S  \  fz  -  fx'  } 

(3) 

Thus  (x.  z  )  ■  Ef  if  and  only  if  fx  fx  .  Now  we  can  state  our  existence  theorem: 

Theorem  3:  A  solution  g  to  the  difference  equation  fh  gf  exists  if  and  only  if  Ef  E ^ 

Proof:  To  prove  the  "if  part,  assume  that  E,  F,\.  Kvery  function  /:  5  -  T  ran  be  writ¬ 
ten  as  a  composition  /  6E  in  which  o:  >  Ef  •  T  is  an  injection  and  F:  S  •  S'  Ef  is  a  surjec¬ 
tion.  Also,  since  Ef  E fh  can  be  written  as  a  composition 

i.  In  Mac  I.i-nnan  HC>  introduced  at  this  point  the  idea  of  an  "isomorphic  image"  from  the  calculus  of  relations. 
Phis  was  used  to  prove  a  number  of  existence  theorems  for  functional  differences  Algebraic  methods  obviate  the 
need  for  this  approach  However.  Masse  diagrams  are  still  useful  for  visualizing  functional  differences 
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where  n:  St  E^  -  T  is  an  injection  and  P:  S  Ef  -  S  E ^  is  a  surjection.  Now  we  claim  that 
a  0n<t> f  1  is  a  solution  to  t-he  difference  equation.  This  is  checked  by  substitution: 

gf  -  (0jr0tl)(0F)  -  <?>n F  =  fh 
Therefore  we  have  shown  that  a  solution  exists  if  Ej  C  V 

Now  to  show  the  “only  if’  part  assume  that  there  is  a  g  such  that  fh  =  gf.  Observe  that 
Ej  Egj  is  always  true,  since  g  cannot  separate  values  that  have  already  been  mapped  together 
by  /.  But  since  fh  -  gf.  E ^  ~  Egf,  and  therefore  Ej  C  E^.  □ 


Theorem  4:  Suppose  5  ?■  1  and  the  equation  fh  =  gf  has  a  solution  g.  Then  this  solution  is 
unique  if  and  only  if  /  is  surjective. 

Proof:  We  prove  the  contrapositive  of  the  "only  if’  part.  Therefore  suppose  that  f:  S  ■  T  is 
not  surjective.  Therefore  there  is  a  y  e  T  such  that 


y  f  R  Irn  /  -  {  y  y  -  fx  for  some  x  (  S  } 

(5) 

We  construct  a  g  different  from  g  that  also  solves  the  equation.  Let  g‘  y  =  a  *  gy.  which  is  pos¬ 
sible  so  long  as  S’  /  1.  Note  that  since  y  f  R.  g'  f  gf,  and  hence  g’  f  fh. 

For  the  "if  part,  suppose  that  both  g  and  g'  are  solutions  and  that  /  is  a  surjection.  Hence, 


gf  fh  gf 


(6) 


Since  /  is  surjective  it  has  a  right  inverse;  compose  with  both  sides  of  Lq.  6  to  yield: 


g  g’ffr 1  gffr 


Hence,  g  g  and  the  so  the  solution  is  unique. 


1 


V 


Obviously  it  is  a  critical  issue  whether  /  is  surjective  or  not.  Therefore  we  investigate  the 
relationships  between  the  differences  of  surjective  and  nonsurjective  functions. 

Definition  3:  The  difference  equation  fh  gf  is  called  homogeneous  if  /  is  surjective,  and 
nonhomogeneous  if  /  is  not  surjective. 

Corollary  4-1:  Homogeneous  difference  equations  have  at  most  one  solution;  nonhomogene¬ 
ous  difference  equations  do  not  have  unique  solutions  (i.e.,  they  have  no  solutions  or  more  than 
one  solution). 

Proof:  Follows  from  Theorem  4  and  the  definition  of  homogeneous.  □ 


Next  we  characterize  the  many  solutions  of  a  nonhomogeneous  equation  as  a  family  of  functions 
derived  from  an  associated  homogeneous  equation. 

Definition  4:  if  5  C  T,  we  use  js^T  for  the  trivial  injection  of  S  into  T :  js^Ti  -  i- 

Definition  5:  Suppose  that  f:  S  -  T,  g:  T  —  T.  h:  S  -  5,  and  R  -  Im  /.  Note  that  f  can 
be  written  uniquely  in  the  form  /  =  jR^jf  where  /':  5  -  R.  Then  we  call  fh  gf  the  homo¬ 
geneous  equation  associated  with  the  nonhomogeneous  equation  fh  =  gf. 

Definition  6:  If  /:  5j  -*  T  and  g:  S2  -*  7\  then  we  define  the  direct  sum, 
(f  -  g):  (5,  *  S\)  -  T ,  by 

Ifz  if  *  *  5 1 

(/*?)•''  1  gz  if  x  6  S2  (") 


Theorem  5:  Let  f:  S  •  T,  g:  T  *  T.  h:  S  -  S,  R  Im  /,  Q  -  T  R  and  j  Jr^t-  Tl'en  9 
is  a  solution  to  the  nonhomogeneous  equation  fh  gf  if  and  only  if  it  can  be  written  in  the  form 


vv  here  g,  :  R  ■  R  is  the  solution  of  the  associated  homogeneous  equation,  and  r:  Q  *  R. 


Proof:  For  the  ’‘only  if'  part  assume  that  fh  =  gf  has  a  solution.  Therefore. 


Im  g  Im  gf  ~  im  fh  _  Im  /  =  R 

Hence,  Im  g  Z  R.  This  means  that  g  can  be  written  as  the  direct  sum  in  Eq.  10.  It  remains  to 
show  that  gQ  is  a  solution  to  the  homogeneous  equation  fh  =  g0f ' .  Since  fh  =  gf,  f  =  jf'  and 
9  -  j(9o  ~  c)i  we  know: 

)f'h  =  j(9o  ~  c)]f 

Since  j  is  an  injection,  we  can  compose  its  inverse  on  the  left  of  both  sides  of  this  equation  to 
yield: 

/'A  =  (<?o  *  c)jf 

Now  notice  that  ( g0  -  c)j  -  g0:  therefore  fh  =  g0f  and  we  have  proved  that  gQ  is  a  solution. 
In  fart  it  is  the  unique  solution  because  the  equation  is  homogeneous. 

To  prove  the  '‘if’  part  we  assume  that  there  is  a  g0  such  that  fh  g0f '.  Let  g  j(g0  ~  c): 

our  goal  is  to  show  fh  -  gf.  Noting  again  that  (j0  -  c)j  o0,  derive: 

fh  jfh 
J9of 

j(90  *  c)if 
9! 

Hence  g  solves  the  nonhornogeneous  equation. 


form  of  the  solution  of  the  nonhomogeneous  equation. 
Proof:  Follows  from  the  preceding  proof,  c 


3.  Examples  of  Differences 

In  this  section  we  give  several  examples  of  functional  differences.  We  begin  with  numerical  func¬ 
tions,  since  they  are  most  familiar.  Let  IN  be  the  natural  numbers  and  let  cr:  IN  ♦  IN  be  the  suc¬ 
cessor  function.  We  use  the  presection  and  postsection  notations  Wile  '73  :  a  -  z  a  *  x. 
b  z  --  x  -  6,  etc.  Also,  we  let  represent  exponentiation,  a  *  n  a”. 

Definition  7:  We  write  ‘(power,  /)  n'  for  the  nlfl  power  of  function  /  applied  to  init'ai  value 
a:  (power,  /)  n  fn  a.  This  is  defined  recursively: 

(power,  /)  0  =  a 

(power,  /)  (n  +  1)  =  f  (power,  /)  n  ,  for  n  0  (10) 


We  rail  powera  /  *the  power  from  a  of  f\  If  /:  -  S  and  a  ‘  S.  then  it  is  clear  that 

powera  /:  IN  -  S. 

Theorem  6:  The  difference  of  the  power  (from  a)  of  /  with  respect  to  successor  is  /, 


a  A  power,  /  /, 


(ID 


provided  that  power,  /  is  surjective. 

Proof:  This  follows  directly  from  the  definition  of ‘power': 

(power,  /)  (<r  n)  /  (power,  /)  n 
Therefore,  (power,  /)  o  f  (power,  /). 


Theorem  7: 


o  A  power,  /  f)  ■  jr 


*  hrrc  j  jff  .  s-.  R  Im  ( jjow(*rfl  /)  and  r:  (>  //)  •  A*. 


Proof:  Let  rr:  H  ■  R  he  [lower,  /  with  its  range1  restricted  to  R.  Thus. 

jn  [Kiwcr,  / 

Since  r  is  surjective,  it  A  it  exists.  Observe  that 

Im  f)  Im  /(power,/)  Im  (power, /)er  1m  (power,/)  R 

’Therefore',  ,f  /' s  domain  is  re'stricte'd  to  //  then  its  image  is  a  subset  of  R.  Hence  there 
O:  R  •  R  such  t  fiat 

JO  fj 

The  definition  of  [lower,  /  is  equivalent  to: 

jna  (power  J)a  /(power ,/)  fjw  jon 

Hence,  jrrr  jar.  Composing  a  left  inverse  of  j  with  hot  h  sides  of  the  equation  yields 

rra  -  <pJ r 

Since  7r  is  surjective  <r  A  ir  <p.  Then,  by  Cor.  5-1, 

a  A  power,  /  c  A  jn 

j(a  A  rr  -  c) 
j(o  -  <■) 

jO  ■  jc 

fj  •  Jc 


-«)- 


Now  observe  that 


a  - ; 

-  power  4  o 

a 

=  power a  o  1 

-  a 

power  a  a 

a  *  | 

-  power0  a  -r 

« *] 

=  powerj  a  x 

Notice  that  the  last  two  of  these  are  not  surjective.  The  differences  of  these  functions  follow  from 


the  theorem: 

a  A  a  — ; 

=  a 

a  A  a  - 

=  ax 

a  A  a 

=  o 

a  A  a  x  : 

=  a  ~  j  +  jc  where  j 

j\m  j«  *]  -  IN 

o  A  [a  t  j 

=  a  x]j  +  jc  where  j 

=  hm  |«  t]  -  N 

4.  Properties  of  Differences 

We  develop  a  number  of  simple,  useful  properties  of  functional  differences. 

Theorem  8:  The  functional  difference  of  the  identity  I:  5  -*  S  with  respect  to  any  function 
h:  S  ->  S  is  that  function:  h  A  I  =  h. 

Proof:  Observe  that  g  =  h  satisfies  lh  =  g I  and  that  I  is  surjective,  c 

Theorem  9:  A  functional  difference  of  h:  S  -*  5  with  respect  to  itself  is  itself.  Further,  if  h. 
is  surjective  then  k  A  h  -  h. 

Proof:  Observe  g  h  satisfies  hh  -  gh.  n 


Corollary  9-1:  A  difference  of  a  power  of  a  function  with  respect  to  that  function  is  that 


function.  Also,  if  hn  is  surjective  then  h  A  hn  h. 

Proof:  Let  g  ~  k  in  hn  h  ghn.  l 

Theorem  10:  A  (left)  inverse  of  a  difference  of  a  function  with  respect  to  a  surjection  is  a 
difference  of  the  function  with  respect  to  a  (right)  inverse  of  the  surjection.  That  is.  if  fh  gf 
then 

/V  -  ft' 7 

(16) 

If  /  is  surjective,  then  (/t  A  /);  1  =  hr  1  A  /. 

Proof:  Suppose  A  is  a  surjection  and  there  is  a  g  satisfying  fh  -  gf.  Suppose  that  gt  1  is  a  left 
inverse  of  g.  Then  compose  gf1  with  both  sides  of  fh  =  gf.  This  yields  gt  1  fh  -  f.  Since  h  is 
surjective  it  has  a  right  inverse  hrl.  Composing  with  hr  1  on  both  sides  of  /  g{  1 fh  yields:  fhr  1 
=  (/,  */.  Hence  gf1  is  a  functional  difference  of  /  with  respect  to  A r 

It  will  usually  be  clear  to  drop  the  /  and  r  subscripts  and  write  (h  A  /)  1  h  '  A  /. 

Theorem  11:  A  difference  of  a  composition  of  two  functions  with  respect  to  a  third  is  a 
difference  of  the  first  function  with  respect  to  a  difference  of  the  second  with  respect  to  the  third. 
That  is,  if  <f>  is  a  difference  of  g  with  respect  to  h  and  v  is  a  difference  of  /  with  respect  to  <t> .  then 
t/>  is  also  a  difference  of  fg  with  respect  to  h.  Also,  if  /  and  g  are  surjective. 
h  A  fg  (h  A  «,)  A  /. 

Proof:  The  derivation  is  direct.  Suppose  gh  -  <pg  and  f<t>  =  ri'f.  Then 

{fg)h  --  figh)  fi<t>g)  ifo)g  --  (vf)g  --  vifg)- 

Hence.  (fg)h  v(fg)-  If  /  and  g  are  surjective  then  the  differences  are  unique. 

Corollary  11-1:  If  g  is  surjective  and  /  is  any  function  such  that  the  differences  exist,  then 


h  A  fg  {h  A  9)  A  /. 


3 


Proof:  Suppose  that  /  =  j<p ,  with  <p  surjective.  We  expand  the  general  form  for  the 
difference: 


h  A  fg  -  h  A  j<t>g 


=  ;(/i  A  <£9  +  c) 

=  j;( /i  A  9)  A  <t>  +  c] 
=  (A  A  g)  A  ;<A 
=  (A  Aj)  A/ 


The  third  line  above  follows  from  the  preceding  theorem,  n 


Theorem  12:  The  difference  of  a  bijection  with  respect  to  a  composition  of  functions  is  the 
composition  of  the  differences  of  the  bijection  with  respect  to  each  of  the  functions: 

gh  A  /  =  (g  A  /)(A  A  /) 


Proof:  Since  /  is  bijective  it  has  the  two-sided  inverse  /  hence  by  Theorem  1: 
ffA  A  /  =  fghf~l 


=  /j(r7)A/-‘ 

=  (fgr')wr') 

=  (9  A  /)( A  A  /) 


The  preceding  theorem  provides  a  kind  of  chain  rule  for  evaluating  differences  of  bijections.  In 
the  following  theorem  we  extend  it  to  any  functions  with  differences. 

Theorem  13:  A  functional  difference  of  a  function  with  respect  to  a  composition  of  functions 
is  the  composition  of  the  difference  of  the  first  function  with  respect  to  each  of  the  other  func¬ 
tions.  That  is,  if  <p  is  a  difference  of  /  with  respect  to  g  and  v  is  a  difference  of  /  with  respect  to 
h.  then  04'  is  a  difference  of  /  with  respect  to  gh. 


Proof:  Since  fg  =  <pf  and  fk  =  if f  we  may  derive: 


f(9h)  =  ( fg)h  =  ( Of)h  -  <*>{fh)  -  <p(v'/)  -  ( Oi/’)/ 

Hence  / ( gA )  =  and  4> ^  is  a  functional  difference  of  /  with  respect  to  gh.  3 

Corollary  13-1:  If  /  is  any  function,  gh  A  /  =  (j  A  f)(h  A  /),  provided  the  differences 
exist.  Note  that  if  /  is  not  surjective,  this  corollary  asserts  the  identity  of  the  general  forms  of 
the  differences. 

Proof:  If  the  differences  exist,  then  they  may  be  written 

g  A  /  =  j(gA <t>  +  c),  h  A  /  =  A0  -  c') 
where  jo  -  f .  Now  observe  the  product: 

( g  A  /)(/i  A  /)  =  ;(ffA<£  +  c)j{hA<j>  +  c') 

=  j(gAO)(hA<fi  +  c') 

=  ;|(gA0)(AA<f>)  +  (gA<£)c'’ 

=  J  [g^4>){hA<t>)  +  c"; 

=  ](ghAd>  +  c"  ) 

The  last  line  follows  by  the  preceding  theorem;  it  is  the  general  form  of  gh  A  f.  □ 

Corollary  13-2:  A  difference  of  a  function  with  respect  to  the  nth  power  of  a  function  is  the 
nth  power  of  a  difference:  hn  A  f  =  (h  A  f)n . 

Proof:  This  is  an  inductive  application  of  the  previous  theorems.  J 
We  use  a  product  notation  for  compositions: 

li  F,  =  F\  •  h\  ■  •  ■  ■  ■  Fn_x  ■  Fn 

i  i 


I  sing  this  notation  we  can  express 


Corollary  13-3:  A  difference  of  a  function  with  respect  to  a  product  of  functions  is  the  pro¬ 


duct  of  differences  with  respect  to  each  of  those  functions: 


(n*.)^/  =  n  (*. *  /) 

i=i  i=i 


Proof:  An  inductive  application  of  the  theorems.  □ 


(18) 


Corollary  13-4:  If  xn  -  finx0 ,  then  fxn  =  (h  A  f)n  (/z0),  where  h  A  /  is  any  difference  of  / 
with  respect  to  h.  That  is,  if  yt  =  fxt  then  yn  =  (h  A  f)ny0 ■  Equivalently,  y  -■  poweryo  h Af. 

Proof:  This  is  an  induction  based  on  j,  =  /  [hxn_ ,)  =  (h  A  f)  (fxn_l)  -  (h  A  /)  yn_,.  □ 


Corollary  13-5:  If  xn  = 


Yin, 

i=i 


z0  and  y,  =  Fxt  then  yn  = 


JIH,AF 

.  =  1 


y0- 


Proof:  This  is  just  an  application  of  Cor.  13-3.  □ 


This  theorem  tells  us  how  to  use  functional  differences  to  get  from  fx0  to  fxn,  provided  xn  is 
reachable  from  x0.  It  is  a  functional  difference  analogue  of  Taylor's  Theorem. 

We  define4  ‘A/’  so  that  (Af)  h  =  h  A  f.  Since  Af  leaves  h  unspecified,  we  call  it  the 
indefinite  functional  difference  of  /.  One  difficulty  with  this  notation  is  that  (A f)h  is  defined 
only  if  E,  C  Efk  (Theorem  3),  and  is  single  valued  only  if  /  is  surjective  (Theorem  4).  To  avoid 
these  problems  we  restrict  the  notation  Af  to  the  case  in  which  /  is  bijective,  since  then  we  are 
guaranteed  that  the  indefinite  difference  exists  (Theorems  2  and  4). 


Definition  8:  The  indefinite  functional  difference  Af:  (S  -*  5)  -*  (T  —  T)  is  defined: 


(A  f)h  =  h  A  f 


(19) 


for  any  bijection  /:  5  -*  T.  Note  that  the  signature  of  A  is: 


4.  This  is  simply  the  postsection  notation  from  Wile  '73  . 


A:  Bijec  (S,  T)  -  (S  -5)  -  (  T  *  T) 


(20) 


where  Bijec  (5,  T)  is  the  category  of  all  bijections  from  5  to  T, 

Theorem  14:  The  indefinite  difference  of  the  composition  of  bijections  is  the  composition  of 
the  indefinite  differences  of  the  bijections: 

A  (/•</)  (A/)  ‘  (Aj/) 

Proof:  By  Theorem  11: 

(A  fg)h  -  h  A  fg 

(‘Aj)A/ 

(A  f)(h  A  g) 

A /  (A  «,)A 

Hence,  A  fg  A/  ■  A</.  n 


The  preceding  theorem  is  a  kind  of  chain  rule  for  functional  differences.  It  leads  to 

Corollary  14-1:  The  indefinite  difference  of  the  nth  power  of  a  bijection  is  the  nth  power  of 
the  indefinite  difference  of  that  bijection:  A  /"  =  (A/)n. 

Proof:  This  is  just  the  inductive  extension  of  the  previous  theorem,  u 


Corollary  14-2:  The  indefinite  difference  of  the  product  of  bijections  is  the  product  of  the 
indefinite  differences  of  those  bijections: 


n  /.  =  n  a/, 

it  it 


That  is,  h  A 


ru 

■  i 


n  ±f, 

■ = i 


(h) 


Proof:  This  also  follows  inductively  from  the  theorem. 


■  1 5- 


5.  Recursive  Programs 


Let  T *  be  the  type  of  all  LISP-like  lists  whose  members  are  of  type  T.  Consider  the  following 
equations,  which  define  the  function  length:  T*  -  [S'  on  lists: 

length  nil  =■  0 

length  (x  :  y)  =  1  -r  length  y  (21) 

(Here  'x  :  y'  denotes  the  result  of  prefixing  x  on  the  list  y  ~  the  LISP  'cons'  operation.)  The 
second  equation  is  a  homogeneous  functional  difference  equation,  as  can  be  seen  by  writing  it  in 
the  form: 


length  “  x  :  =  a  •  length 


(22) 


(Note  that  x  :  :  T*  -  T*.)  Hence  it  is  easy  to  see  that  the  change  in  length  with  respect  to 
prefixing  is  the  successor: 


x  :)  A  length  =  a 


(23) 


On  the  other  hand,  if  we  were  to  define  length  recursively,  we  would  write  something  like  this: 


length  L 


0,  if  L  ~  nil 

1  +  length  (rest  L),  if  L  *  nil 


(24) 


This  corresponds  to  the  equations 

length  nil  =  0 

length  L  1  *  length  (rest  L ).  for  L  *  nil  (25) 


The  second  equation  here  is  also  a  sort  of  difference  equation,  but  it  does  not  fit  our  earlier  form. 
Written  in  terms  of  compositions  it  is: 


length  j .  <r  length  rest 


(2(i) 


where  we  have  composed  length  with  ].  to  restrict  it^  domain  to  nonnull  lists.  The  function 

-  Ifi- 


<■  ■ 


v.v 


.  injects  the  type  of  nonnull  sequences  T'  into  the  type  of  (possibly  null)  sequences 


T*.  Note  also  that  we  assume  ‘rest’  is  a  total  function,  rest:  T '  •  7”.  Hence  the  domains  and 
ranges  of  the  functions  match  as  required  by  the  compositions. 


What  is  the  relationship  between  the  two  difference  equations  satisfied  by  length?  Consider 
the  first  difference  equation  (22): 


length  x  :  o  *  length 


(22) 


We  would  like  to  compose  with  the  inverse  of  x  :  on  both  sides.  Unfortunately  we  can’t  do  this 
because  x  :  is  not  a  surjection,  so  it's  not  right  invertible.  Therefore  we  will  have  to  use  an 
alternate  approach. 


Let  xT‘  7"  represent  the  type  of  all  sequences  that  begin  with  x.  Since  the  meaning  of 
i  :  is  to  put  i  on  the  front  of  its  argument,  we  will  consider  the  bijection  x z:  T*  -*  xT*\  this 
operation  is  x  :  with  its  range  restricted  to  xT% .  Hence  x  :  J.Jrnz'  where  jz  -  jzT._r  -  Since 

x  is  a  bijection.  it  inverse  trr1:  xT'  •  T *  exists  (and  is  a  bijection).  The  meaning  of  irzl  is  to 
take  i  off  the  front  of  a  sequence  that  begins  with  x.  On  the  other  hand  ‘rest’  takes  the  first 
thing  off  the  front  of  its  argument  no  matter  what  it  is.  Hence  xz  1  is  like  ‘rest’  except  that  it’s 
defined  only  on  lists  whose  first  element  is  x.  That  is,  x z  1  is  a  restriction  of  ‘rest’  to  the  domain 
xT’ .  xzl  rest  }r 

Now  we  make  two  simple  observations.  First,  the  type  of  all  nonnull  lists  is  the  direct  sum. 
for  all  /.  of  the  nonnull  lists  that  begin  with  x: 


T'  Yj  iT* 

i.  T 


Second,  the  'rest'  function,  which  deletes  the  first  element  of  a  list  no  matter  what  it  is,  is  the 
direct  sum  of  all  the  functions  xz  *,  which  delete  x  from  the  front  of  a  list: 

rest  rest  £  jz  £  rest  jz  £  *r  1 

/•  T  f  T  it  T 


It  is  now  easy  to  show  the  two  difference  equations  are  equivalent. 
Theorem  15:  Suppose  that 

length  »  [x  :  =  o  length 

is  true  for  all  x.  Then 

length  •  =  a  °  length  “  rest 

The  converse  also  holds. 

Proof:  To  prove  the  first  (Eq.  27)  implies  the  second  (Eq.  28)  we  have: 

er  ■  length  length  •  x  : 

length  •  j.  •  jz  >  xz 

Compose  on  both  sides  with  nz  1  to  yield: 

a  length  •  ir~ 1  =  length  •  «  jz 

Now  derive: 

length  <  j.  length  - 

z(  T 

E  (length  "  y+  •  ;J 

j.  T 

E  (<r  •  length  »  tr;1) 
zf  T 

-  <r  »  length  »  J]  nzh 
x,  T 

<7  length  >  rest 


(27) 


(28) 


This  is  Eq.  28. 

To  prove  the  second  (Eq.  28)  implies  the  first  (Eq.  27)  we  restrict  both  sides  to  xT*: 

length  j .  jz  cr  length  •  rest  j 


-18- 


wr 


Recalling  that  rest  1  jz  --  r,1: 

length  j„  ’  jz  a  length  -  tz  1 
Now  compose  with  irz  on  both  sides  to  obtain  Eq.  27.  : : 

6.  Definition  and  Existence  of  Integral 

In  this  section  we  consider  a  functional  integration  operation  that  is  inverse  to  the  functional 
difference.  That  is,  given  functions  g:  T  —  T  and  h:  S  S  we  want  to  find  an  /:  S  -*  T  that 
satisfies  the  functional  difference  equation  fh  =  gf. 

In  general  there  may  be  many  functions  satisfying  this  relationship.  Since  this  implies  that 
the  solution  to  a  functional  difference  equation  is  often  underdetermined  by  the  equation,  to 
determine  a  particular  solution  it's  necessary  to  specify  a  boundary  function  b  contained  in  the 
solution.  Thus  the  solution  to  the  equation  is  required  to  be  an  extension  of  the  boundary  func¬ 
tion  (i.e..  b  f]o~S'  w^ere  D  c-  S). 

Definition  9:  Suppose  D  C  S.  Let  arbitrary  functions  g:  T  -  T.  h:  S  S  and  6:  D  —  T  be 
given.  If  there  is  a  function  /:  5  -*  T,  with  b  =  fjp^g,  satisfying  the  equation 

f  ‘  h  -  g  -  f 

then  we  call  /  the  definite  functional  integral  with  respect  to  h ,  from  6,  of  g.  We  write  /: 

h  $(,  9 

This  is  read  ,lthe  h  integral  from  b  of  g.  " 

Theorem  16:  If  the  definite  functional  integral  exists,  then  it  satisfies  the  equation: 

(*$>?)  *  9  (*$»?) 


Proof:  follows  immediately  from  definition. 


Next  we  explore  some  of  the  conditions  under  which  functional  integrals  exist. 


Definition  10:  5  is  generated  from  D  by  A:  S  -  5  if  and  only  if 


s  -  u  h\l>. 


(The  notation  A"  D  denotes  the  image  of  D  under  An.)  This  is  equivalent  to  S  satisfying  the 


recursive  equation 


S  =  D  u  A|Si 


Note  that  if  5  is  generated  by  A,  then  A  is  surjective. 

If  the  generation  of  5  loses  information  that  is  required  by  g ,  then  the  functional  integral  can¬ 
not  be  computed:  this  is  formalized  in  the  following  theorems.  To  state  them  we  introduce  the 
class  of  functions  for  which  functional  integrals  will  be  shown  to  exist: 

Definition  11:  Suppose  g:  T  -*  T,  b:  D  —  T,  and  S  is  generated  from  D  by  A:  S  —  S.  We 
say  that  the  functions  gk  b  ignore  the  generation  of  S  if  and  only  if.  for  all  x0,  r0  t  D.  m ,  n  0, 


Amx0  -  Anx0 '  gmbx0  -  gnbx0' 


That  is.  the  functions  gkb  don’t  care  if  an  element  of  5  can  be  generated  in  two  or  more  wavs. 

Lemma  17-1:  Suppose  b:  D  —  T.  f:  S  —  T.  g:  T  —  T,  b  -  fjp^S'  an^  $  is  generated  from 
I)  by  A.  If  fh  gf  has  a  solution  then  the  functions  gkb  ignore  the  generation  of  5. 

Proof:  Let  x  e  S’  and  j  -  jp^s-  Suppose  hmjx0  x  bnjx0'  for  x0,  x0 '  e  D.  (Note  that  for 
x0  •  D.  jx0  x0.)  By  Cor.  13-4, 

fx  fhm)i0  qn,fj*0  -  gmbx 0 
A  9nfj*o'  9*  bio 


Hence.  gmbx0  gnbxQ‘ . 


:o 


Next  we  give  a  formula  for  the  h  integral  from  b  of  g.  It  is  defined  in  terms  of  the  graph  of 


the  function. 


Definition  12:  If  b:  D  -  7\  h:  S  -  S,  g:  T  -  T.  and  I)  S.  define  the  relation  as  fol- 


^hbc  =  {  9nf>r o)  x0  D-  n  *  0  } 


Lemma  17-2:  If  the  gkb  ignore  the  generation  of  5,  then  there  is  a  unique  function  ohb  such 


graph  <t>kbg  <t>kkg 


where  graph  /  is  the  graph  of  the  function  /  (i.e.,  the  set  of  (x,  y)  such  that  fx  y.).  Further. 


this  function  satisfies 


o)  9nl>x 0  forx0t  D 


Proof:  Clearly  there  is  at  most  one  function  d>:  S  *  T  having  a  given  graph.  Thus  it  is  necessary 


to  show  that  o  Ohbg  is  defined  and  single  valued  for  every  member  of  5.  Since  S  is  generated  by 


b  from  D.  each  z  f  5  can  be  written  z  bnz0  for  some  j0  D.  n  >  0.  Hence,  from  the  definition 


of  4*^  we  see  oz  is  defined  and 


Ox  9nbzQ,  for  x  hnx0 


To  show  ox  is  single  valued,  assume  bm j-(,  bnx0  ' .  By  Hq.  35. 


Ox  grnbx0.  ox  g^bz^’ 


Hu t  the  gkb  ignore  the  generation  of  S.  so  gmbx0  -  gnbx0  '.  Hence.  O  is  single  valued. 


Next  we  prove  that  Obb.  is  a  solution  provided  the  gk  b  ignore  generation. 


Lemma  17-3:  If  the  gkb  ignore  the  generation  of  .S',  then 


°hbg  9®hbq 

(36) 

I’roof:  For  an  arbitrary  x  -  S  we  show  <phz  -  g<?z,  where  o  Ohbg.  Since  S  is  generated  from  D 
l>\  h.  write  z  bnjz0.  where  j  =  jg^s-  Then, 

ohz  ohn'l]zQ ,  since  x  -  hnjz0 

by  Lemma  16-2 

goz.  bv  Kq.  35 


We  can  now  prove  our  principal  existence  theorem: 

Theorem  17:  Let  6:  >’  •  >.  t>:  l)  -  T.  g:  T  •  T.  and  suppose  >’  is  generated  from  l)  by  6. 
Tin'll  fh  gf  has  a  solution  if  and  only  if  the  gk b  ignore  the  generation  of  5. 

Proof:  This  follows  from  Lemmas  17-1  and  17-3. 

Our  next  goal  is  to  show  that  o is  the  unique  solution  of  the  difference  equation. 

Lemma  18-1:  Suppose  h:  S  -  S.  6:  l)  •  T.  g:  T  •  T.  and  /:  5  •  T.  If  the  gkb  ignore  the 
generation  of  >'  and  /  is  a  solution  to  fh  gf.  then  /  Oht>9. 

Proof  Suppose  z  A"/,-,  for  /0  I).  M\  Cor.  13-4, 

A  /*V..  g”fjr  0  o  °bb,z 

Theorem  18:  Suppose  h:  >  •  6:  I)  *  T.  g:  T  ■  T.  If  >'  is  generated  from  l)  by  h.  but 

the  9*6  ignore  this  generation,  then 


Proof:  This  follows  from  Lemmas  17-3  and  18-1.  ~ 


7.  Properties  of  Integrals 

The  following  corollaries  follow  easily  from  the  preceding  theorems  and  from  the  properties  of 
differences  in  section  4. 

Corollary  18-1: 


gnbi0 ,  for  r0  t  D 


(38) 


Proof:  Follows  from  Theorem  18  and  Lemma  17-2.  : 


Corollary  18-2:  h  <|)jd  h  I. 

Proof:  Follows  from  Thm.  8.  z 

Corollary  18-3:  h  h  =  h. 

Proof:  Follows  from  Thm.  9.  □ 

Corollary  18-4:  h  <J),.  h  -  hn. 

"  Jd  ‘S 

Proof:  Follows  from  Cor.  9-1.  1- 

Corollary  18-5:  Suppose  h:  R  ■  R.  6:  S  -  S’,  r:  T  -  T.  b :  S0  -  T,  c:  R0  •  where 


Sn  S’  and  R0  R.  Then,  if  the  vkb  ignore  the  generation  of  S  by  o.  and  the  ok r  ignore  the 
generation  of  R  by  h ,  and  the  v*6c  ignore  the  generation  of  R  by  h.  then 


(0  $6  V’)(*  $f  <^)  =  *  3>6jr  ^ 


(39) 


t: 


P 


P. 


R 


fc: 


V" 


where  j  =  J5  s 


Proof:  Follows  from  Thm.  13.  □ 


The  following  two  theorems  are  the  Fundamental  Theorems  relating  fixed  differences  and 
integrals. 


Theorem  19:  Suppose  /:  S  -*  T,  h:  S  —  S  and  b  =  fjD^s,  where  S  is  generated  from  D  by 
h.  If  Ef Efa  and  /  is  surjective. 


h$b(hAf)  =  / 


(40) 


Proof:  Under  the  stated  conditions  the  difference  equation  fh  =  gf  has  a  unique  solution 
g  h  A  /.  To  show  that  /  is  the  functional  integral  of  g  with  respect  to  h  we  must  show  that 
the  gkb  ignore  the  generation  of  5  by  h.  Therefore  suppose  hmjxQ  =  hnjx0\  where  j  =  jD^s. 
Then, 


gmbxQ  =  gm  fjx 0,  by  definition  of  6 
=  fhmjx0,  Cor.  13-4 
=  fhnjx0',  by  hypothesis 
gnfjx0\  Cor.  13-4 
-  g" bx0,  by  definition  of  6 


Hence  /  is  the  h  integral  from  6  of  g:  h  (J);,  g  =  /.  Combining  with  g  =  h  A  f  yields  the  desired 
result.  :: 


Theorem  20:  Suppose  h:  S  -»  5,  b:  D  •  T,  g:  T  -»  T,  and  S  is  generated  from  D  by  h. 
Then. 
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if  and  only  if  T  is  generated  from  6 [D\  by  g. 

Proof:  Under  the  stated  conditions  the  integral  /  =  h  <J>4  g  exists.  The  difference  will  exist 
and  be  unique  if  /  is  surjective  and  Ef  C  E^.  To  determine  the  conditions  under  which  /  is  sur¬ 
jective  we  compute  a  formula  for  the  image  of  /: 

Im  /  =  rng  <J>A6j 

=  rng  {  (hnx0,  g"biQ)  I  i0  -  D.  n  >  0  } 

-  {  9nbx o  Iq  ■:  D,  n  0  } 

=  Im  gn b 

n  ^0 

Now  observe  that  T  (j  Im  g"b  if  and  only  if  T  is  generated  from  6  l)  by  g. 

n 

Next  we  must  show  Ef  E fh.  Therefore  assume  fx  fx  ;  that  is.  fh^x^  fhnx0'.  My  Lem. 

17-2,  fbmz0  ~  gmbx0  and  fhnx0'  gn6z0'.  Hence,  gmbxc  g''bxC)  ■  Now  derive: 

fhx  -  fhm-lx0  -  gm~lbx o 
'  9{gmbx  0)  =  g(gnbx  0') 

=  g"'bx0'  -  fh"xx 0' 
fhx' 

Hence  Ef  E ^  and  the  difference  is  unique,  n 

The  following  corollary  shows  that  the  difference  of  a  nonsurjective  integral  is  the  integrand  plus 
a  remainder  term. 


Corollary  20-1:  If  T  is  not  generated  from  b  l)  by  g,  then 


.'V". r.*  V  r  A  -.W  'V'  "  »  -V  -_v  -.V  -  »  -w»  »_!'  "J.- 


a 


A  A  (a$,j) 


W  +■  Jc 


where  A:  S  -  5,  6:  D  -  T,  g:  T  -  T ,  ;  =  c:  (T  R)  ->  /?,  and  R  -  Im  (j  <J>4  g). 

Proof:  Let  Q  -  T  -  R.  Since  /?  =  Im  (A  $4  y)  we  can  write  g  =  jq  +  r  where  q:  R  —  R 
and  r:  Q  ->  T.  Note  that  q  is  surjective  and  /?  is  generated  from  b\D\  by  q.  Hence  A  <j>,  q 
exists,  where  a:  D  —  R,  ja  =  6.  Note  that  A  g  =  j(A  9)  and  apply  Cor.  5-1: 

A  A  (A  j)  =  A  A  j(A  <£,  9) 

=  j  h  A  (A  <£,  9)  -  cj 

=■  j(q  +  c) 


since  A  9  is  surjective.  Now  observe  that 


gj  =  (jq  +  r)j  =  jq 


Hence  the  difference  of  the  integral  is  gj  +  jc.  □ 


The  functional  integral  permits  a  different  characterization  of  the  power  functional: 
Theorem  21:  The  o  integral  from  0  -»  a  of  /  is  the  power  from  a  of  /: 


°  /  =  power,  / 


Proof:  Note  that  IN  is  generated  from  {0}  by  er;  to  show  the  existence  of  the  integral  we  must 
show  that  the  /*  •  ( 0  -  a)  ignore  this  generation.  Hence  we  need 

<rm0  =  on 0  fm{ 0  -  a) 0  /”(0  -  a)0 

The  left-hand  side  of  this  implication  is  equivalent  to  m  n.  which  obviously  implies  the  right- 
hand  side.  Therefore,  the  functional  integral  exists  and  satisfies  the  following  equation: 


(*$0..  f)ff  /(*$(!•■/ 


■wmw  totiy  w  niwwiif wtwiwiww,1 w  uiuiimi 


v 


'JI".J*JMPJU8Ji  'UUWWIIU1ll!Wn 


(4-1) 


But  this  is  just  the  difference  equation  which  defines  the  power  function. 


The  following  corollary  is  Thm.  7,  but  obtained  via  the  integral. 


Corollary  21-1: 


a  A  power,  /  =  fj  +  jc 


(45) 


where  j  =  jR^s  and  R  =  1m  (power,  /). 


Proof:  By  the  theorem: 


a  A  power,  /  =  a  A  (a  $0^,  /)  =  fj  -  jc 
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